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ABSTRACT 


A  stationary  independent  Increment  process  Is  the  continuous 
time  analogue  o£  the  discrete  random  walk,  and,  as  such,  has 
a  wide  variety  of  applications.  In  this  paper  we  consider 
M(t)  ,  the  maximum  value  that  such  a  process  attains  by  time 
t  .  By  using  renewal  theoretic  methods  we  obtain  results 
about  M(t>  .  In  particular  we,  show  that  if  u  ,  the  mean 

drift  of  the  process,  is  positive,  then  converges  to 

y  ,  and  E(M(t  +  h)  -  M(t))  -*■  hp  . 


ON  THE  MAXIMUM  OF  A  STATIONARY  INDEPENDENT  INCREMENT  PROCESS 

by 

Sheldon  M.  Rose 

Let  (X(t)  ,  t  >.  0}  be  a  separable  stationary  independent  increment  process 
continuous  in  probability  and  with  X(0)  ■  0  .  Suppose  that  E[X(t)]  =  yt  where 
y  >  0  ,  and  let 

M(t)  ■  sup  X(s)  . 

0<s<t 

Theorem  1: 

(i)  M(t)/t  y  as  t  “ 

(ii)  EM(t)/t  -*■  y  as  t  -*■  *  . 

Proof; 

Fix  some  constant  b  >  0  ,  and  define  T  ,  J  ,  n  >  1  ,  by 

n  n  — 

Tx  -  inf  {t  :  X(t)  >.  b}  ,  XCT^  -  b  + 

Tn  “  ln£  {t  !  X(t)  1  b  +  X(Tn-l)}  *  X<V  "  b  +  x(Tn~i)  +  Jn  ’  n  >  1  . 

Now,  due  to  the  stationary  independent  increment  assumption,  it  follows  that 

{Tn  “  T  j.  ,  n  >_  1}  is  a  renewal  process.  Letting  N(t)  be  the  number  of 

renewals  by  time  t  for  this  process,  i.e.,  N(t)  -  max  {n  :  T  <  t}  ,  we  have 

n  — 

(1)  bN(t)  +  +  •  •  •  +  JN(tj  <  M(t)  <  bN(t)  +  J1  +  ...  +  JN^  +  b  . 

Now,  from  the  strong  law  of  large  numbers  and  the  renewal  result  N(t)/t  a4-s*  l/E^ 


we  have  that 
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b  +  EJ 

1/t  (bN(t)  +  Jx  +  ...  +  JN(t))  a48’  — 


Now,  from  a  similar  theorem  in  discrete  time  (i.e.,  Stein's  lemma) ,  it  follows 


that  ET^  <  <*>  and  thus  from  Martingale  theory 


E[b  +  Jx]  -  E[X(T1) ]  -  yETx  , 


and  hence  (i)  follows  from  (1),  (2)  and  (3).  To  prove  (ii) ,  we  first  note  that 


1/t  E[bN(t)  +  Jx  +  ...  +  *  bEN(t) / t  + 


EJ1(EN(t)  +  1)  E[JN(t)+1] 


by  Wald's  equation.  However  by  regarding  as  a  reward  earned  at  the  time  of 

the  ith  renewal  it  follows,  since  EJ^  <  “  ,  by  standard  arguments  ([1],  Page  53) 
E[JN(t)+l] 

that  - p-1 * - *■  0  .  Hence,  by  the  elementary  renewal  theorem, 


b  +  EJ 

1/t  E[bN(t)  +  JJl  +  ...  +  JN(t)]  ^  •  -  -  )i 


and  (ii)  is  proven. 


Theorem  2: 


If  E[X  (t)]  <  00  ,  then,  for  each  h  >  0  , 


E[M(t  +  h)  -  M(t) ]  -*■  hy  . 


Proof: 


By  (1)  we  have 


Q.E.D. 


b(N(t  +  h)  -  N(t) )  +  +  ...  +  JN(t+h)  "  (Jx  +  ...  +  JN(t)>  -  b  <  M(t  +  h)  - 


M(t)  <  b(N(t  +  h)  -  N(t) )  +  Jx  +  ...  +  JN(t+h)  -  (J1  +  ...  +  JN(t))  +  b  . 


"PPW 


Wfm? &#•**•: 


Taking  expectations,  and  using  Wald's  equation,  yields 

(b  +  U^IDKt  +  h)  -  N(t)]  +  «UH(t)+1J  -  EU„(t+h)+1J  -  b  < 

E[M(t  +  h)  -  M(t) ]  <  (b  +  EJ^)E[N(t  +  h)  -  N(t)J  +  I[JM(t)+1]  - 

E*JN(t+h)+lJ  +  b  • 

We  shall  show  in  the  ensuing  lemma  that  lim  ®CJM(t)+1l  exists  and  is  finite. 

Hence,  the  result  follows  from  the  above  by  first  applying  Blackwell's  theorem 
and  then  letting  b  -*■  0  . 

Q.E 

Lemma  1 : 

If  E[X2(t)J  <  -  ,  then 


lim  E[J, 


ElJjTj  3 

]  ■-.i  ,  ■  <  - 


IZ  1  N(t)+lJ  E[Tl3 


Proof: 


Let  g(t)  «  E[J 


N(t)+1^  and  let  F  denote  the  distribution  of  .  Then 


eo 

8(t)  -  J  *[J„(t)+1  |  Tl  -  xJdF(x) 


0 

t. 


"  J  g(t  -  x)dF(x)  + 

0  t 


00 

/  E1J1  I  T1 


x]dF(x) 


This  renewal  type  equation  has  the  solution 


g(t)  -  h(t)  +  /  h(t  -  x)dm(x) 


4 


where 


h(t) 


x]dF(x)  . 


From  the  key  renewal  theorem  it  follows  that 


lim  g(t) 


x]dF(x)dt 


00 

|  xEl^  I  Tj  -  x]dF(x) 


where  the  interchange  is  justified  by  the  nonnegativity  of  rewards.  That 
E^J1T1^  <  00  follows  from  a  similar  result  in  discrete  time.  (The  discrete  time 
result  states  that  for  a  random  walk  with  positive  drift  whose  steps  have  finite 
variance,  the  variance  of  the  value  of  the  process  the  first  time  it  exceeds  b 
is  finite.  The  equivalent  discrete  time  version  of  E[J^T^]  <  »  then  follows 
from  Stein’s  lemma  upon  application  of  the  Cauchy- Schwarz  inequality.) 

Q.E.D. 

Remarks : 

The  technique  employed  in  the  above  proof  is  similar  to  the  ladder  variable 
approach  in  fluctuation  theory.  That  is,  we  say  that  a  ladder  point  is  reached  not 
when  the  process  attains  a  new  high  but  when  it  passes  the  previous  ladder  height 
by  at  least  some  fixed  value.  It  is  to  be  hoped  that  this  technique  will  prove 
useful  in  studying  other  properties  of  stationary  independent  increment  processes. 
Also  this  approach  should  be  contrasted  with  the  approach,  recently  developed  by 
M.  Rubinovitch,  in  which  a  point  t  is  said  to  be  a  ladder  point  if  M(t)  =  X(t)  . 
By  applying  the  theory  of  regenerative  events,  as  developed  by  Kingman,  Rubinovitch 


5 


is  then  able  to  obtain  many  interesting  results. 

For  a  discrete  time  proof  of  (i) ,  the  interested  reader  should  consult 
Heyde. 
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